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Much of the material and all of the recommendations which follow are taken 
from a manuscript published by the Center for Linguistic Studies entitled Stirrings 
in Teacher Education .^ The purpose of this earlier document is to present a view 
Irom those of us in the educational community who are responsible for implementing 
federal programs and conducting their evaluation* Specifically^ that document fo-> 
cases on the Trainers of Teacher Trainers (TTT) Program as it was funded and ad- 
ministered under EPDA, The book itself sets a background by discussing the nation- 
al program and its relationship to the Indiana University-Bloomington TTT Project, 
then outlines the many dimensions of the Indiana University project inclusive of im- 
pact on both institutions and individuals, and terminates with a set of recommenda** 
tions to federal agency personnel, local project personnel, and local agency person- 
nel in leadership positions. 

The recommendations which follow are taken from that document anrf are addressed 
to federal agency personnel. Each recommendation is based upon our experience in 
the TTT program. Many of the recommendations have grown out of our i- x.^eriences with 
the implementation and evaluation processes which were employed at « i. the nation- 
al and local level. Many others focus upon the results of those proct -ses. In the 
event that further clarification is needed in order to fully understa.^ any one of 
the recommendations which follow, reference should be made to chls eanier and more 
complete document. 



Realistic Time Frame for Educational Change 

Some process needs to be devised to inform the Congress and persons in leader- 
ship positions in the Executive Branch of government of how long it takt-s to build 
an educational program of TTT magnitude at both the national and local Ic^vels. It 
cannot begin in an undernourished state » receive a subsistence diet tor two years, 
become aware that it will die in two more, and blossom into rigorous maturity in 
the meantime. Five years appear to be a fairly typical lifespan for fecUral pro- 
grams. Local projects may be even shorter. It is a wonder that these programs have 
any impact at all under such conditions! 



Funding for Planning 

Funding strategies should take into account the peculiar nature of the plan- 
ning period. More than any others, the planning period should be one in which the 
participants have an oppo-^tunity to extend their imagination— to dream a little and 
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look beyond the limitations and constraints o£ the field. Unfortunately » most local 
project staffs are only given the opportunity to plan within the constraints of pro- 
posal preparation. If Office of Education personnel could provide a more extended 
period of planning--after tht* grant is made and with funds available for the purpose- 
more coherent programs, greater parity, and purposeful evaluation might be the result. 

Ex pectations of National Ajsencles 

National agencic^^^ should not create unreasonable expectations with regard to 
levels of funding on the part of persons submitting proposals. Local personnel do 
tailor their plans and budgets to the expectations which funding agencies create, and 
rightly so. In popular parlance, one has to know what game he is playing in order 
to follow the rules. If agency personnel indicate that they plan to distribute six 
millii>n dollars In ten or twelve grants and that they expect programs of considerable 
magnitude, that is precisely what local personnel will deliver. If such expectations 
are considerably off the mark when funds are disf.ributed , some disillusionment and the 
cutting of viable program components is likely to ensue. The easiest way to avoid this 
is for federal agency personnel to anticipate the actilSns and reactions of Congress 
and other key persons and to establish realistic budget expectations in program guide- 
lines. This reccmmendation is made with the understanding that federal program per- 
sonnel usually do not have lull control of the situation and may in turn he respond- 
ing to actions taken by others. 



Programs as Process 

Program personnel must acknowledge the evolutionary nature of the national pro- 
gram and the impact its own evolution is likely to have on local projects. There are 
many Issues that arise from the developmental interplay btitween the national and lo- 
cal programs. The one need that clearly emerges from our experience is the need to 
provide sufficient lead time for local projects— to study, understand, and respond 
to changes at the national level. Particular attention should be paid to the rela- 
tionship between proposal preparation and program implementation. In the TTT program, 
we began developing proposals in the summer of 1970 which would become programs in 
the fall of 1971. If new information came to us from the national program in the fall 
of 1970--for example, the need to stress community involvement--it could not be acted 
upon in any meaningful way until the summer of 1971, and it could n<>t be incorporated 
in any substantial program form until the fall of 1972. Hard as it is to believe, 
this i:; a two year time lag. We are not advocating that nothing can or should be 
done in the two year period that intervenes, but any major effort cannot begin until 
two years later. The reason is simple. Money is required to finance a major change 
in program. Since funding requests have already been submitted for the following 
year, it Is unlikely that any program not already called for will emerge at that 
time. To do so is to thwart all the planning that went into the current proposal 
and that is not a good procedure for winning friends at the local level. A major plan- 
ning effort and some limited actions can be initiated at the local level and probably 
will be if project personnel are at all serious about the new direction, but these 
are not the sort of activities that represent a major change in program. Admittedly > 
the time lag could have been reduced by half if the announcement had been made a few 
months earlier but this only reinforces another point— that national program person- 
nel must time their announcements carefully to be effective in promoting change in 
local programs » 
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Provlding sufficient lead time and carefully timing announcements will go a long 
way toward resolving the problem, but there are other steps that can be taken. Now 
expectations should be stated In clear terms. It is not always easy for project per- 
sonnel to Jtscem the difference between "required" and "suggested" changes, and some- 
times expectations stated as suggestions are Interpreted as requirements by both lo- 
cal and national personnel. By stating Its Intentions clearly, the office of Educa- 
tion will not be penalizing those who decide not to follow such "suggestions." 

A set of "trail markers" should be provided to aid project staffs in deter- 
mining whun they are making appropriate changes. Even when local personnel want to 
follow the spirit of federal guidelines, they may not find it easy to do so. Speci- 
fic trail markers will help them to know when and where progress Is being made. 

Finally, national program personnel should take Into account the entire range of 
projects that are operative at the local level and reflect such an understanding 
through appropriate variation? in procedures. This may require the establishment of 
different guidelines for different types of projects accepting different criteria and 
procedures for meeting the same guidelines. This probably will not come as a complete- 
ly new suggfstion to federal personnel. Indeed, many may fct-l they already do such 
things. 



Funding Cycles 

The preceding discussion suggests another recommendation: that careful thought 
be given to the possibility of revising federal funding cycles. The annual cycle has 
several problems associated with It. In the first place, renewal proposals must be 
submitted before the latest program has begun and considerably before there is enough 
experience with it to know what new needs and problems have emerged. Moreover, far 
less than a one-to-one relationship exists between program planning and proposal pre- 
paration. Far from synonymous, these two sets of activities often emphasize, if rot 
require, quite different skills. One calls for persons who can create and implement 
new ideas; the other, for persons who can articulate and "sell" those Ideas. Ideally, 
the latter process should be based upon and emerge from the former. Under present 
patterns of funding, the reverse la often true. A longer funding cycle would make 
It possible to escape from these constraints by allowing more time for program develop- 
ment before the next proposal is due. 



A number of alternatives to the annual cycle should be explored. I'or example, 
renewal proposals could be prepared by local personnel on a biennial basis while new 
requests are entertained annually. Continuing requests could also be staggered to 
penrilt more careful scrutiny of programs up for renewal each year. If a biennial 
cycle were adopted one half of the programs would be examined each year. Another 
variation would be to entertain only requests for major program revisions each year 
while the present level of support continued for a two year period. A number of such 
alternatives should be given careful study at the national level. 



Support Vehicles 

Support vehicles should be established as part of any large-scale national pro- 
gram of funding. Such support vehicles should be carefully designed to service both 
the needs of the national agency and of local projects as well. The TTT staff deserves 
credit for establishing perhaps the broadest array of such vehicles ever developed 
for a national program of funding, e.g., a leadership training program, a systematic 
program ot national and reKi^nal conferences and an instructional evahiatluu and re- 



ERIC 



0008 



-4- 



th!''n»r"***7"' "<ese vehicles did appear to serve the needs of 

be «id Trl;:?': "«"/'<°«« 05 the local projects. Social attenti ,n neLs to 



Staggered Evalnafinn 

nrinM^if''?"^!"'' directors of national programs give serious thought to the 

llnll ll . KwTf ' ^r^"^''^'^'- S^^P^J^ this means that evflL t ion dead- 

in L ^''t*^!^^*^^^/^ different times for different .jects. patu can be collect- 

and so on''"'/'''"f^'^' T^^""'" ^ ^'"^^ ^''^"P another timer 

data the nirlr" cycle would be repeated wouud depend upon the need for * 
data, the number of projects being funded, and similar factors. 

This principle has several things to recommend it. First. It would rtsult in 
a more rigorous program of evaluation with a smaller number of proiects hwolvo^^ 

f 1 r« . c ^T/ :'^ evaluation, if desired, some data would be repented enof. 

hv ^«l"«tion and other purposes. Local projects would »>e less burdened 

?^!rfnn The evaluation effort would be less expensive and data col- 

drawn forLcJar'^Jf'"" """u" I' "^'^ taanageable. Moreover, samples could be 
un?vLitv .V ! f °" ^^'i' ""'^ P'^^J"^ characteristics as locations, 

university size, type of program, and so on. An evaluation schedule, drawn early n 
the process, would permit project staffs to anticipate data collection efforts well 
ooratirfL ^^^.^^i'^Plr-'f ^^^'^ undesignated efforts could be nco - 
?hlt not rir'^'^^'^f "^'^ T^' recommendation is based upon the assumption 

^h?! . ^'.r''^!''^ evaluated at the same time for funding purposes. Even 

evalui^ir'T"°;.^' "^^""'"^ agencies, they could employ sta,«e re.' 

evaluations for other purposes. r 7 f.h «. 



Emphasize Quality and Quantity 

cma^tltV'''''?h^«^cr^^^^''' ^^T'^ t^^^^^^^,^ f Pl«c«'» "Pon quality rather than 
forrr^i^ui ^^rltenon should be applied to both national and local ev., I.mi 1.,.. el 
forts. With programs a., complex as TTT, there is the danger of too much evaluation 
for the needs of the Individuals and groups involved. Emphasizing qualitv rather 
t^runji'^**"'. providing coordination for the various efforts tiU ulZ " reduce 
««L evaluation overkill-that is, evaluation being used for its own 

sake rather than assisting the decision making process. 

^^v./"fT^f ^f**"" quantity often reflects poor planning. When the specific objec- 
l^Ih H^^.T ' ^Ki*''! identified in advance, there is the urge to collect is 
Zlt.t T in the hope that some of it will be useful. While such an ap- 

proach does yield data of value, it is a terribly Inefficient way to obtain it. Pre- 
planned evaluation results in a more efficient design for data collection. The dis- 
cussion of :4taggered evaluation is very much directed at this point. 



Feedback 



Data collected for naclonal porposes could be of conHiderable value to lotnl 
project pernonnel. To be ot maximum value, thrtc condltlouH must Iw met. The «hUa 
umst he pre»ont».d In understandable lorm. U must make use of a variety of comnu.ni- 
^ cation vehicles. Finally. It must be timed to the needs of locarprojects 
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that th^lt . r I*"**'' "hat the national data (including 

brief narratli^ not Lr?o™ Jh^; f „T ' °f accompanied by a 

of feedback U nec^^v Lch a^r^Z li * f^^f-Hy P»a™^<i program 

^o'^raT>iT^- 

'ho?J so^n'^^r "n'J""- ^J""" "1"° feedback o«r a "ela^U-eW 

»pri"g could be ::;Eur : ZTrlT " 't" """ributed " the 

Places a Rreater^fhL^ Z ^Jl i"^*""*"* following year. Such a program 

pVrSLr" d"^^^^^^^^ :?^hiX';u:!uy!"L^rar 

'L^™rc'uX"B?a™^^^o::L^^^^^ " '"^ " co»un.catins t^ ConJes^^J Cuhin 

Evaluation p acklaRh 

la.h ''proeJZ Tl^l T ""^^S " """" evaluation back- 

!V •^"S'ams as complex as TTI are particularly susceptible to tUs effect 

tr ?:-ir:?[r?r"- ^-es^rdnmand^!'%rL"Cdt%= tt ^tr'^' 

the result will be lower response rates» hurried responses, growlns resistance 

•CuiJh?.*' ' '^"'"^^^ ^^^^^"^^"^"^ whiitakei Tgrthc^: cr;,„.u 

bllltrirtrcotwrl ^« -^^^^ <^ounter backlash. One po.sl- 

Pres^^allv tSi! ^jnaller quantity of data during the course of th.> prelect. 

PresutnaUy, this will require fewer collection efforts as well. S»au«ered data col - 

gtief pr^ e t ?ina'lK'":: 'T. 'T' 'Tt''' '^'^ ^^^^ Iwe'f irlnd r on 
heirtrL!™;ii!i Jk^* coordination of the local approaches to evaluation may also 

ut'd^^Tien :onhiii:i^i:;t.'^"^"^'^^"^ "^^^"^^^ ^"^^-^ ^-^^ ^-^'-^^ 

Demands on Local Project S^aff 

cal protect\tff"fs^«nd^T?^ ^^^^^ ""^"^ ^'^"^"'^^ ^^^"8 made on lo- 

nroi^r^ the impact of these demands upon the local program. When 

posi!s develL^'^ticr^'f' conferences, complete data fonnf, preparrpro- 

t/J T articles for newsletters, and Implement a local pro8ram.-£.ll in the 
same time frame.-they may be hard pressed to find the time. AlthougS we tried to rC 

X" ndia;rsta?f'oi:r:? jr^^r fr •^^^^^^ - ?epr.se„t:tiJL 

«iL f! ! «taff placed Its priorities on local activities, which may not have been 

?lere'weTe%w^ im ^r an\''^^ particularly critical in'such .atter" 

mere were two important Instances wlien we felt that the Office of Education's tim- 
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Ing was tnappropriato . One was the announcement of the site visit early in the 
operational . same; tht? other a request for three separate evaluations in the same 
time trame. Evaluation requirements are considerable and should be thought out 
carefully. With better timing, some tasks that seetm-d quite onerous would have 
b>en less so. 



C o n clusion 

To even the casual reader* this list of recommendations appears to be strong 
criticism of the evaluation efforts made by or on behalf of the national EDPA-TTT 
programs. While the recommendations make some criticisms of the national TTT pro- 
gram, these criticisms should not be construed as a general indictment of the en- 
tire program or its personnel. The national TTT staff took on an enormous task— 
to bring about significant change in teacher education— and they left their mark 
on the future developments in this field. As individuals, the national TTT person- 
nel were warm and cooperative, listened carefully to our complaints and requests, 
and responded to them when they felt they could. Perhaps the most use J ul point to 
be made from the recommendations is fotmd in an earlier observation that the lUM-dri 
of the national program and those of the local projects arc not identical and at 
times may even he in conflict. For example, national domand« upon local pr..)ect 
staffs during early stages of development can present a distracting annoyance at 
bast and, at worst, a potential threat to the stability and soundnesti til' the pro- 
ject. They frequently focus time and energy away from local needs, vie for the at- 
tention of local participants, and overload the resources of local projects at a 
time when such projects have all they can do to pull themselves together. At the 
same time, as local project personnel, we acknowledge the need and right of the 
national program to be evolving its goals and activities as we are evolving ours. 
The national staff seldom has any more lead time — and may in some instances have 
less— than it has provided us. Still some thought and effort must focus on this 
dilemma at both levels if wist and practical solutions are to be found. 
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